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Relationship  of  Employee  Attitudes  and  Supervisor-Controller 
Ratio  to  En  Route  Operational  Error  Rates 


Air  traffic  controllers  ensure  the  safe,  orderly,  and 
expeditious  flow  of  air  traffic  through  the  National 
Airspace  System  (NAS).  To  ensure  the  safety  of  flight, 
controllers  maintain  adequate  separation  between  air¬ 
craft  and  obstacles  to  flight.  They  issue  speed,  alti¬ 
tude,  and  heading  commands  to  pilots  to  provide  and 
maintain  required  separation.  An  operational  error 
(OE)  results  when  an  Air  Traffic  Control  Specialist 
(ATCS,  “air  traffic  controller,”  or  “controller”)  fails 
to  maintain  appropriate  separation  between  aircraft, 
terrain,  and  other  obstacles  to  safe  flight.  The  number 
of  OEs  per  100,000  facility  activities  (“OE  rate”)  has 
long  been  an  index  of  NAS  safety.  Reduction  in  the 
OE  rate  is  a  safety  goal  for  the  FAA  “line-of-business” 
responsible  for  the  delivery  and  management  of  air 
traffic  services.  For  example,  the  Air  Traffic  Services 
Performance  Plan  FY200 1-2003  (Air  Traffic  Services, 
2000)  calls  for  the  reduction  of  OEs  by  2.5%  per  year 
in  FY2002  and  FY2003. 


However,  the  OE  rate  has  increased  in  recent  years. 
For  example,  the  number  of  OEs  increased  from  754 
in  fiscal  year  (FY)  1997  to  1,194  in  FY2001.The  goal 
for  FY2001  was  812  errors  (Figure  1).  The  rate  also 
increased,  from  .51  to  .68  per  100,000  facility  opera¬ 
tions  (Department  of  Transportation  Office  of  the 
Inspector  General,  2000,  2002).  Explanations  for  the 
increase  include  better  reporting  and  increased  traffic. 
Possible  situational  and  individual  causal  factors  have 
been  investigated  in  several  studies  (see,  for  examples, 
Broach,  1999;  Della  Rocco,  Cruz,  &;  Clemens,  1999; 
Endlsey  &  Rodgers,  1997;  Rodgers  &c  Nye,  1993; 
Rodgers,  Mogford,  &  Mogford,  1998;  Schroeder  & 
Nye,  1993).  The  Center  for  Naval  Analyses  Corpora¬ 
tion  (CNAC,  1995)  examined  the  relationship  of 
individual  characteristics,  staffing  ratios,  and  facility 
characteristics  to  en  route  OEs  for  the  period  1990 
through  1995.  There  appeared  to  be  little  correlation 
between  the  supervisor-controller  staffing  ratio  and 
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Figure  1:  Actual  operational  errors  (OE)  and  goal  by  fiscal  year  (Adapted 
From  Department  of  Transportation  Office  of  the  Inspector  General,  2002) 
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the  OE  rate  (p.  94).  CNAC  concluded  that  the  num¬ 
ber  of  OEs  were  primarily  a  function  of  the  complex¬ 
ity  of  the  sectors  being  supervised  rather  than  individual 
characteristics  of  the  supervisor  (p.  97). 

This  study  replicated  and  extended  the  CNAC 
study  by  focusing  on  the  influence  of  organizational 
characteristics  on  OE  rate  at  the  21  continental  air 
route  traffic  control  centers  (ARTCCs,  or  centers). 
Organizational  characteristics  have  been  hypothesized 
to  influence  the  occurrence  of  human  errors  (Reason, 
1990;  Shappell  &  Wiegmann,  2000).  Organizational 
characteristics  in  the  Human  Factors  Classification 
and  Analysis  System-Air  Traffic  Control  (HFACS- 
ATC;  Scarborough  &  Pounds,  2001)  include  (a) 
organizational  climate,  (b)  organizational  structure,  (c) 
policies  and  procedures ,  and  (c)  resource  management. 

Organizational  climate  in  HFACS-ATC  refers  to 
the  working  atmosphere  within  the  organization.  An 
organizational  climate  characterized  by  confusion  and 
conflict  may  have  a  detrimental  effect  on  safety 
(Shappell  &  Wiegmann,  p.  13).  Job  satisfaction,  for 
example,  might  serve  as  an  overall  indicator  of  the 
organizational  climate.  Schneider  (2001)  investigated 
the  relationship  of  job  satisfaction  to  operational 
errors  in  the  en  route  environment.  Facility  mean 
scores  were  computed  for  selected  items  from  the 
FAA’s  1997  Employee  Attitude  Survey  (EAS). 
Schneider  then  correlated  those  scores  with  the  num¬ 
ber  of  OEs  for  each  en  route  facility  (N  =  21).  No 
significant  correlations  between  operational  errors 
and  various  measures  of  job  satisfaction  were  found. 
Organizational  structure  refers  to  attributes  such  as  the 
ratio  of  supervisors  to  controllers  and  the  hierarchical 
organization  of  the  facility.  The  1995  CNAC  study 
reported  no  significant  correlation  between  OE  rates 
and  the  ratio  of  supervisors  to  controllers.  However, 
Fisher  (2001)  qualitatively  linked  reductions  in  the 
number  of  operational  supervisors,  an  organizational 
structure  characteristic,  to  increases  in  operational 
errors.  Other  facets  of  organizational  structure  might 
include  the  degree  of  oversight  exercised  over  employ¬ 
ees,  and  the  accountability  of  management  employees 
for  performance.  Policies  and procedures  in  the  HFACS- 
ATC  refer  to  the  broad  class  of  corporate  decisions 
and  rules  that  structure  everyday  working  life.  Kinney 
(1977)  qualitatively  described  how  organizational 
policies  influenced  the  occurrence  of  operational  er¬ 
rors.  However,  no  recent  research  has  investigated  the 
influence  of  organizational  policies  and  procedures. 
Finally,  resource  management  in  HFACS-ATC  en¬ 
compasses  the  allocation  of  organizational  assets  such 
as  personnel,  money,  and  facilities  or  equipment.  One 
aspect  of  resource  management  might  be  employee 


perceptions  of  the  quality  of  equipment,  the  facility 
overall,  and  maintenance  services.  The  purpose  of  the 
present  study  was  to  explore  possible  relationships 
between  several  of  the  organizational  facets  proposed 
by  HFACS-ATC  to  OE  rates  in  today’s  air  traffic 
control  system. 

METHOD 

Data  sources 

OE  rates  (errors  per  100,000  operations)  were 
obtained  from  the  National  Airspace  Incident  Moni¬ 
toring  System  (NAIMS)  for  calendar  years  1997  and 
2000  for  21  U.S.  ARTCCs.  The  combined  en  route/ 
approach  control  facilities  in  Guam,  Hawaii,  and 
Puerto  Rico  were  excluded  from  the  analysis  as  they 
are  operationally  different  from  the  2 1  continental  air 
route  traffic  control  centers.  Response  data  for  se¬ 
lected  items  from  the  EAS  for  the  years  1 997  and  2000 
were  used  to  construct  the  organizational  factors  used 
in  this  study.  Staffing  data  for  1997  and  2000  were 
extracted  from  the  FAA’s  Consolidated  Personnel 
Management  Information  System  (CPMIS),  the 
agency’s  official  system  of  personnel  records. 

Organizational  factors 

Items  from  the  EAS  for  1997  and  2000  were 
selected  to  represent  the  organizational  factors  hy¬ 
pothesized  to  influence  operational  errors  in  the 
HFACS-ATC  model.  The  EAS  is  a  broad  instrument 
used  to  assess  FAA  employee  perceptions  of  the  work¬ 
place  (Thompson,  et  al.,  2000).  Sufficient  organiza¬ 
tional  demographic  data  were  collected  from  each 
respondent  to  allow  segmentation  of  the  data  by 
workforce  and  facility.  The  overall  response  rate  from 
the  21  centers  were  41%  in  1997  and  33%  in  2000. 
Centers  have,  on  average,  about  300  controllers,  with 
the  exception  of  Anchorage  which  has  just  over  200 
controllers. 

The  mapping  of  1997  and  2000  EAS  items  and 
scales  to  the  HFACS-ATC  organizational  factors  is 
shown  in  Table  1.  Only  items  that  had  remained 
unchanged  between  the  two  EAS  administrations 
were  considered  to  ensure  comparability  across  years. 
A  measure  of  the  internal  consistency,  known  gener¬ 
ally  as  Cronbach’s  alpha  (a;  Cronbach,  1951),  or  the 
degree  to  which  the  items  were  related  to  one  another, 
was  calculated  for  each  set  of  items  selected  to  repre¬ 
sent  a  HFACS-ATC  factor.  Cronbach’s  a  can  be 
computed  if  there  are  at  least  two  items  in  the  scale. 
Higher  values  for  Cronbach’s  (X  for  a  HFACS-ATC 
factor  indicated  greater  consistency  in  responses  to 
the  items,  while  lower  values  indicated  less  consistency. 
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Table  1: 

Mapping  of  EAS  items  to  HFACS-ATC  organizational  factors 
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Although  there  is  no  absolute  cut-off,  scales  with 
alphas  of  less  than  about  .5  to  .6  are  not  commonly 
used  in  research,  as  the  scores  on  such  scales  are  viewed 
as  unreliable. 

There  were  multiple  items  from  both  iterations  of 
the  EAS  related  to  the  HFACS-ATC  organizational 
climate  factor.  Two  EAS  items  specifically  assessed 
job  satisfaction,  and  three  directly  assessed  employee 
trust.  A  scale  to  represent  the  workforce  attitudes 
(HFACSAT1;  Cronbach’s  a  =  .73)  was  constructed 
from  these  five  items.  The  underlying  hypothesis  was 
that  facilities  with  higher  satisfaction  and  trust  were 
more  likely  to  have  lower  error  rates.  Another  aspect 
of  organizational  climate  is  the  extent  to  which  em¬ 
ployees  were  willing  to  work  hard.  Two  items  from 
the  EAS  addressed  this  facet  of  the  facility  organiza¬ 
tional  climate  (HFACSAT2;  Cronbach’s  a  =  .67), 
with  the  underlying  hypothesis  that  facilities  with 
higher  levels  of  willingness  to  work  hard  would  have 
lower  OE  rates.  How  employees  are  socialized  into  the 
organization  plays  a  role  in  determining  the  organiza¬ 
tional  climate.  Six  items  were  identified  from  the  EAS 
related  to  the  informal  socialization  process 
(HFACSAT3;  Cronbach’s  a  =  .81).  The  underlying 
hypothesis  for  these  items  was  that  facilities  with  more 
positive  perceptions  of  informal  socialization  pro¬ 
cesses  would  have  lower  error  rates. 

The  organizational  structure  factor  of  the  HFACS- 
ATC  model  was  represented  by  two  scales  derived  by 
combining  EAS  items.  First,  three  EAS  items  refer¬ 
ring  to  managerial  accountability  and  commitment  to 
customer  support  were  combined  to  represent  general 
supervision  (HFACSAT4;  Cronbach’s  a  =  .58).  We 
expected  that  facilities  with  more  positive  perceptions 
of  general  supervision  would  have  lower  OE  rates. 
Second,  four  EAS  items  specifically  focused  on  em¬ 
powerment  were  used  to  represent  decision-making 
structure  (HFACSAT5),  with  the  expectation  that 
facilities  with  higher  levels  of  perceived  empower¬ 
ment  would  have  lower  error  rates.  However,  this 
“decision-making  structure”  scale  was  dropped  from  the 
analysis  due  to  poor  reliability  (Cronbach’s  a  =  .25). 

The  policies  and procedures  facet  of  the  organization 
was  reflected  in  two  scales  constructed  from  the  EAS. 
Six  EAS  items  addressed  human  resources  manage¬ 
ment  policies  such  as  training  and  promotion  oppor¬ 
tunity  (HFACSAT6;  Cronbach’s  a  =  .68).  As  with  the 
other  HFACS-ATC  scales,  we  hypothesized  that  fa¬ 
cilities  with  more  positive  perceptions  of  human  re¬ 
sources  management  policies  would  have  lower  error 
rates.  Five  EAS  items  focused  on  performance  manage¬ 
ment  (HFACSAT7;  Cronbach’s  a  =  .67).  We  hypoth¬ 
esized  that  facilities  with  more  positive  perceptions  of 


performance  management  would  also  likely  experi¬ 
ence  lower  error  rates.  Finally,  resource  management 
was  reflected  by  a  single  scale  addressing  the  quality  of 
equipment  and  facilities.  A  single  EAS  item  was  used 
to  represent  employee  perceptions  of  the  quality  of 
equipment  and  facilities  (HFACSAT8),  with  the  ex¬ 
pectation  that  more  positive  perceptions  would  be 
reflected  in  lower  facility  error  rates.  Scale  scores  were 
calculated  for  each  respondent.  The  six  reliable,  multi¬ 
item  scales  and  HFACSAT7  (a  single  item  scale)  were 
then  aggregated  by  year  and  facility.  The  resulting 
data  file  included  facility  identifier,  number  of  re¬ 
spondents,  and  the  facility  mean  scores  on  the  seven 
HFACS-ATC  scales  (HFACSAT1  to  HFACSAT4, 
HFACSAT6  to  HFACSAT8)  by  year  and  facility. 

Employment  data  extracted  from  the  FAA’s  CPMIS 
were  used  to  estimate  the  supervisor-to-controller 
ratio  (SCR)  in  1997  and  2000  for  each  center.  The 
SCR  was  computed  as  the  ratio  of  the  number  of 
Operations  Supervisors  to  the  total  number  of  Certi¬ 
fied  Professional  Controllers  and  controllers  in  train¬ 
ing  at  each  center  at  the  end  of  calendar  years  1997 
and  2000.  The  SCR  represented  an  objective  measure 
of  an  aspect  of  the  organizational  structure. 

Error  data  and  analyses 

Operational  error  data  were  extracted  from  the 
National  Airspace  Incident  Monitoring  System 
(NAIMS).  SCR  and  OE  (errors  per  100,000  opera¬ 
tions)  were  matched  by  year  and  center  with  the 
aggregated  HFACS-ATC  scale  data  file  created  for 
this  analysis.  The  OE  rate  was  regressed  on  the  seven 
mean  HFACS-ATC  scale  scores  and  the  SCR.  SPSS® 
for  Windows  (Version  10.0.7;  SPSS,  Inc.,  1999)  was 
used  for  all  file  manipulations  and  statistical  analyses. 

RESULTS 

Descriptive  statistics  across  centers  and  the  correla¬ 
tion  matrix  are  displayed  in  Table  2.  The  correlations 
between  operational  error  rate  (OE_RATE)  and  the 
hypothesized  predictors  were  all  negative  and  signifi¬ 
cant.  The  correlation  between  SCR  and  OE_RATE 
was -.54  (p<  .001;  Figure  2).  In  other  words,  facilities 
with  about  1  supervisor  for  every  6-7  controllers  (SCR 
=  .14  to  .17)  had  lower  error  rates  than  facilities  with 
1  supervisor  for  every  8-10  controllers  (SCR  =  .10  to 
.12). The  moderate  to  moderately  large  correlations 
between  the  HFACS-ATC  factors  suggested  that  col- 
linearity  might  be  problem  for  the  analysis.  Collinear- 
ity  refers  to  the  degree  to  which  the  predictors  are 
related  to  one  another.  When  the  predictors  are  highly 
related  to  one  another,  the  information  each  provides 
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Figure  2:  Correlation  (r=  -.54,  p<  .001)  between  Supervisor-Controller  Ration  (SCR)  & 
Operational  Error  Rate  (OE_RATE) 


may  be  duplicated  by  the  other  predictors.  As  a  result, 
a  regression  analysis  based  on  highly  correlated  pre¬ 
dictors  will  be  unstable,  as  one  predictor  could  easily 
be  substituted  for  another.  Therefore,  in  view  of  the 
apparent  collinearity  among  the  predictors,  regression 
diagnostics  were  examined  during  the  course  of  the 
analysis. 

The  results  of  the  stepwise  regression  of  the  seven 
HFACS-ATC  scale  scores  and  SCR  on  the  opera¬ 
tional  error  rate  are  shown  in  Table  3.  Stepwise 
regression  is  a  technique  for  identifying  the  optimally 
weighted  variables  from  a  given  set  that  best  predict 
the  criterion  (OE_RATE  in  this  instance).  Regression 
diagnostics  provided  little  evidence  of  problematic 
collinearity.  Variance  inflation  factor  (VIF)  scores,  a 
commonly  used  regression  diagnostic,  ranged  from 
1.143  to  1.622  for  the  three  predictor  scales  that 
comprised  the  final  model.  VIF  is  equal  to  1.0  when 
the  predictors  are  independent  and  have  no  correla¬ 
tion  with  one  another;  a  value  of  1 0  or  greater  is  often 
used  as  a  benchmark  indicating  problematic  collinear¬ 
ity  among  the  predictors.  VIF  scores  near  1  indicated 
that  the  optimally  weighted  set  of  variables  that  best 
predicted  OE_RATE  was  stable  and  interpretable. 


Overall,  the  supervisor-controller  ratio  (SCR), 
employee  perceptions  of  how  performance  was  man¬ 
aged  in  the  facility  (HFACSAT7),  and  employee 
perceptions  of  the  quality  of  equipment  and  facilities 
(HFACSAT8)  accounted  for  51%  (Adjusted  R 2  = 
.505,  A(3,38)  =  14.925,  p  <  .001)  of  the  variance  in 
1997  and  2000  operational  error  rates  across  the  21 
centers.  The  other  factors  did  not  meet  the  statistical 
criteria  for  inclusion  in  the  final  model. 

The  adjusted  R2  is  a  conservative  estimate  of  the 
relationship  between  the  predictors  (SCR, 
HFACSAT7,  HFACSAT8)  and  OE_RATE.  The  ad¬ 
justed  R2  indicates  how  well  OE_RATE  can  be  pre¬ 
dicted  from  the  combination  of  weighted  variables. 
An  R2  of  1 .00  indicates  that  the  criterion  (OE_RATE) 
is  perfectly  predicted  from  SCR,  HFACSAT7,  and 
HFACSAT8.  Conversely,  an  R2  =  0  indicates  that 
OE_RATE  could  not  be  predicted  at  all  from  SCR, 
HFACSAT7,  and  H  FACS  AT  8.  An  R2  of  about  .3  is 
very  common  in  the  social  sciences,  particularly  in 
attitude-related  research.  An  R2  of  .5  is  much  less 
common,  and  indicates  that  supervisor-controller  ra¬ 
tio,  employee  perceptions  of  how  performance  is 
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managed  and  the  facilities  and  equipment  have  some 
relationship  to  the  operational  error  rate  at  each  en 
route  center. 

DISCUSSION 

The  results  of  this  descriptive  study  suggest  that 
organizational  factors  might  influence  the  operational 
error  rate  in  en  route  air  traffic  control  at  the  facility 
level.  This  conclusion  provides  support  for  including 
organizational  factors  in  the  analysis  of  operational 
errors  as  suggested  by  HFACS-ATC.  The  regression 
analysis  also  suggests  that  span-of-control,  as  repre¬ 
sented  by  the  supervisor-to-controller  ratio,  may  be 
related  to  en  route  facility  operational  error  rates. 

On  the  one  hand,  the  analysis  indicated  that  both 
subjective  and  objective  measures  might  be  useful  in 
explaining  differences  in  error  rates  between  centers. 
Similar  results  have  been  found  in  examining  organi¬ 
zational  and  work  unit  attitudes  towards  safety  and 
accidents  in  other  settings.  For  example,  Zohar  (2000) 
demonstrated  an  empirical  link  between  perceptions 
of  organizational  safety  climate  and  objective  injury 
data.  Similarly,  Thompson,  Hilton,  and  Witt  (1997) 
demonstrated  how  perceptions  of  organizational  cli¬ 
mate  and  management  roles  might  affect  safety-re¬ 
lated  outcomes.  The  measures  drawn  from  the  EAS 
reflect  subjective  perceptions  of  equipment  and  per¬ 
formance  management.  In  contrast,  the  SCR  repre¬ 
sents  an  objective,  structural  characteristic  of  each 
center.  Overall,  the  present  analysis  suggests  that  it  would 
be  fruitful  for  human  factors  investigations  of  opera¬ 
tional  errors  in  air  traffic  control  to  take  into  account 
subjective  perceptions  of  the  organizational  climate, 
including  perceptions  of  safety,  as  well  as  objective 
characteristics  of  the  organizational  structure. 

On  the  other  hand,  the  study  is  descriptive,  and  it 
is  unlikely  that  future  operational  error  rates  at  a 
particular  facility  can  be  predicted  from  past  measures 
of  employee  attitudes  or  supervisor-controller  ratios. 
Moreover,  the  results  of  this  analysis  are  not  consis¬ 
tent  with  those  reported  by  CNAC  (1995)  with  re¬ 
spect  to  supervisor-controller  ratio.  In  that  study, 
staffing  ratio,  based  on  mid-year  figures,  was  regressed 
on  the  yearly  average  error  rate  (CNAC,  1995,  p.  94). 
It  is  not  clear  from  the  description  whether  the  aver¬ 
ages  were  computed  across  facilities,  across  years,  or 
both.  Consequently,  it  is  unclear  as  to  how  to  inter¬ 
pret  the  results  of  the  present  study  with  respect  to  the 
CNAC  study.  Further  research  is  clearly  needed  to 
explore  and  explain  any  differences  as  well  as  to 
replicate  the  findings  of  the  present  study. 


Finally,  it  must  be  noted  that  this  study  did  not 
examine  relationships  between  attitudes  and  errors  at 
the  level  of  the  individual  controller.  The  unit  of 
analysis  for  this  study  was  the  facility.  The  attitudinal 
predictors  were  composite,  aggregated  average  scores 
at  the  facility  level  created  from  anonymous  survey 
data.  EAS  data  cannot  be  matched  with  OE  data,  as 
the  EAS  is  anonymous,  and  the  final  OE  reports  do 
not  identify  the  involved  controller(s).  The  results  of 
this  study  cannot  be  used  in  any  way  to  predict  the 
likelihood  of  an  individual  controller  being  involved 
in  an  operational  error.  However,  they  do  underscore 
the  need  to  collect  data  at  multiple  levels  of  analysis, 
including  organizational  characteristics  as  well  as  in¬ 
formation  on  the  individual  controllers  involved  in 
errors.  While  the  organizational  data  might  or  might 
not  be  relevant  to  any  single  OE,  patterns  across  errors 
and  over  time  might  be  found.  Identification  of  such 
patterns,  in  turn,  might  guide  interventions  and  risk 
mitigation  strategies  as  the  FAA  actively  seeks  to 
reduce  the  incidence  of  en  route  operational  errors. 
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